Quantum dynamics, particle delocalization and instability of Mott states: 
the effect of fermion-boson conversion on Mott states 
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We study the quantum dynamics of superfluids of bosons hybridized with Cooper pairs near 
Feshbach resonances and the influence of fermion-boson conversion on Mott states. We derive a 
set of equations of motion which describe novel low energy dynamics in superfluids and obtain a 
new distinct branch of gapped collective modes in superfluids which involve anti-symmetric phase 
oscillations in fermionic and bosonic channels. We also flnd that Mott states in general are unstable 
with respect to fermion-boson conversion; particles become delocalized and the off-diagonal long- 
range order of superfluids can be developed when a finite conversion is present. We further point 
out a possible hidden order in Mott states. It is shown that the quantum dynamics of Fermi-Bose 
states can be characterized by either an effective coupled (7(1) ® U{1) quantum rotor Hamiltonian 
in a large-N limit or a coupled XXZ ® XXZ spin Hamiltonian in a single-orbit limit. 



I. INTRODUCTION 

The phenomenon of Feshbach resonances in ultra cold 
atomic gases has attracted much attention. The Zeeman- 
field-driven two-body resonances between fermion pairs 
in open channels and bound molecules provide a fasci- 
nating way to tune the scattering length between atoms 
in open channels. Remarkably, this sort of simple two- 
body physics results in extremely rich quantum many- 
body states in atomic vapors which have not been ex- 
plicitly observed in conventional solid state systems. In- 
deed, by varying the two-body scattering length near 
Feshbach resonances, several groups have successfully 
achieved fermionic superfluids in a strongly interacting 

The superfluids near Feshbach resonances are related 
to the BCS-BEC crossover studied a while ago^^L^; 
this was pointed out by a few groups^iiSiiiiiSii^ii^. Var- 
ious efforts have been made to incorporate the two- 
body resonance between Cooper pairs (open channel) and 
molecules (close channel) explicitly in the many-body 
Hamiltonian and many interesting results were obtained. 
Relations between the multiple-channel model and the 
previous single-channel model have also been studied and 
clarified. 

After all these interesting efforts, a very reasonable un- 
derstanding has been achieved. Three general features of 
Feshbach resonances deserve emphasizing here. The first 
one is that near a Feshbach resonance the usual Cooper 
pairing amplitude and molecule condensate wavefunction 
are proportional to each other. Particularly, phases of 
two components (fermionic and bosonic) in the many- 
body wave functions are completely locked. In most 
cases, it has been shown that molecules mediate an ef- 
fective interaction between fermions. It also has been 
emphasized in various occasions that molecules can be 
integrated out and at low energies one only needs to 



deal with an effective theory of fermions with attractive 
interactions. Indeed, in the mean field approximation 
the Feshbach resonance introduces an effective interac- 
tion between fermions, the interaction constant of which 
is ■ypg/{2fi — v). Here ■ypB is the couphng strength (see 
Eq.(l)), V is the detuning energy of molecules and /i is 
the chemical potential of fermions. 

The second feature is the behavior of many-body states 
at Feshbach resonances. It turns out that the properties 
of states at resonances very much depend on the under- 
lying two-body parameters. If the resonance width is 
very larger compared with the Fermi energy, then at reso- 
nances the energy per particle in unit of the Fermi energy 
of free particles is universal, independent of particle den- 
sities, or background scattering length, or other micro- 
scopic properties of two-body resonances. It is also in this 
limit one can establish an explicit connection between 
the two-channel model currently employed to study the 
physics near Feshbach resonances and the one-channel 
model studied long time ago. However, if the resonance 
width is very narrow, then the properties of many-body 
states further depend on microscopic parameters of two- 
body physics. 

The distinction between these two limits is even more 
severe if one zooms in and looks into the molecule frac- 
tion or the chemical potential at resonances. This is 
the third general feature we would like to turn to. At 
wide resonances, the chemical potential of fermions is 
still of the order of the free particle Fermi energy, while 
the molecule fraction is actually inversely proportional 
to the width and is very small. At narrow resonances, 
the chemical potential is depleted to almost zero and the 
molecule fraction is substantial. 

However, in these previous approaches, three impor- 
tant aspects of this phenomenon have been overlooked, 
and sometimes, miscomprehended. One is the issue of 
quantum phase dynamics of bosons and fermions. If 
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we treat molecules and atoms as independent bosons 
and fermions respectively, there are no particular rea- 
sons why there has to be only one condensate phase for 
two-component supcrfluids. In fact, it is natural to as- 
sume that the bosonic or fcrmionic superfluid has its own 
quantum dynamics. 

In fact, a critical examination of the problem suggests 
there should be two phases. Though in the mean field 
approximation employed in most of previous works on 
this subject, the two phases are usually locked, dynam- 
ically these two phases do have their distinct features 
and are never truly identical. The extra phase degree 
of freedom indicates an extra branch of collective modes 
which can have rather low energies in the limit of narrow 
resonances-7. These new excitations are an analogue of 
small fluctuations of a relative phase between two con- 
densates discussed in RefllGl It remains to be studied in 
details and to be observed experimentally. 

The second issue is related to the possibility of having 
a boson-fermion mixture but with decoupled low energy 
dynamics. Though this possibility hardly exists in high 
dimensions, in ID there can be a phase transition be- 
tween the usual phase locked superfluid and more exotic 
phase unlocked states. The critical point is determined 
by a Sine-Gordon type theory. This was discussed in a 
recent preprin^ii and has received further critical exam- 
ination in a unpublished worki^. 

The third aspect is the new quantum dynamics due to 
the conversion between fermions and bosons. The conver- 
sion actually violates the particle number conservation of 
fermions and bosons respectively and only conserves their 
total number. Although this violation plays little role in 
BEC-BCS crossover superfluids because of the large local 
density fluctuations, it can have a vital impact on other 
many-body states close to Feshbach resonances. One ex- 
ample is the instability of certain Mott states when the 
number conservation is violated. The other example is 
the development of a certain hidden order in Mott states. 
The purpose of this article is to further investigate these 
issues and explore the consequences of these observations. 
A brief discussion on some of these issues was previously 
presentedSl. 

In section II, we introduce a model to study the stabil- 
ity/instability of Mott states of fermion-Boson systems. 
We discuss the validity of the model and the relevance to 
the physics near Feshbach resonances. In section III, we 
exam the stability of certain Mott states of bosons when 
Fermion-Boson conversion is present. We show that the 
conversion leads to delocalization of particles in a Mott 
regime and destabilizes the insulating phase. A Mott 
state appears to develop a finite density of states at en- 
ergies well below the Mott gap. 

In section IV, we further derive an effective Hamilto- 
nian of fermion-boson systems in a large- A'' limit. We 
also obtain the equations of motion and investigate the 
novel quantum dynamics of fermions and bosons in this 
limit. General structures of collective modes are stud- 
ied in a semiclassical approximation. In section V, we 



demonstrate that the delocalization leads to superfluidity 
by explicitly showing the development of the off- diagonal 
long ranger order (ODLO). These calculations also indi- 
cate that strong repulsive interactions between bosons or 
Cooper pairs do not renormalize the superfluid density 
to zero in some limit. In section VI, we examine the hid- 
den order in certain Mott states and point out various 
topological excitations in Mott states. These remain to 
be explored experimentally. 



II. HAMILTONIAN FOR LATTICE FESHBACH 
RESONANCES 

The model we employ to study this subject is an M- 
orbit Fermi-Bose Hubbard Model {FBHM). Consider the 
following general form of FBHM 

H = Hf + Hb + Hfi,; 

{kl),ri,i7 k,r],cr 

Yj flri] flvJkafki1 + Y H " 
k,r},^ k 

Hb = -tb^{blbi + h.c.)+J2i'"-'2tJ-)bibk 

(kl) k 

+ Vb^fibkifibk - 1); 

k 

Hbf = -^IFB '^iblfkri^fkril + h.C.) + Vbf ^ flbkflfk- (1) 
k,ri k 

Here k, rj and a label lattice sites, on-site orbits and spins; 
?7 = 1, 2, ...M, a =t, i. ifkTja) is the creation (anni- 
hilation) operator of a fermion at site k, with on-site or- 
bital energy and spin a. b^f.{bk) is the creation (annihi- 
lation) operator of a boson at site k. For simplicity, we as- 
sume that there is only one bosonic orbital degree of free- 
dom at each site. The fermion and boson number oper- 
ators are, respectively, fibk = b\hk,nfk = Y.n,a flnahvy- 
tf and tb are hopping integrals of fermions and bosons 
respectively, and hopping occurs over neighboring sites 
labeled as (kl). /x is the chemical potential of fermions 
and V is the binding energy of bosons which are made 
up of bound states of fermions. A is the attractive cou- 
pling constant in the Cooper channel which we assume 
to be much larger than the rest of couplings. Finally, 
Vf, Vb and Vbf are the strength of repulsive interac- 
tions between fermions and bosons in the density-density 
channeli' (One further assumes VbVf > V^?^ to ensure 
that homogeneous states are stable). We only include 
conversion between a molecule and two fermions in time- 
reversal doublets, and in Eq. 1, we choose to work with 
doublets of {rj f,?? i)- FBHMs similar to Eq.lQJ were 
previously applied to study Bose-Fermi mixtures in op- 
tical latticeSi^Si; most recently an FBHM with fermion- 
boson conversion was generalized to study the BCS-BEC 
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crossover in lattices^. In the absence of the conversion 
term, FBHM consists of decoupled (attractive) Fermi- 
Hubbard model and Bose-Hubbard model; main proper- 
ties of latter are known^. 

In the FBHM, the conversion is between a molecule 
and two fermions in the same orbit rj. This approxima- 
tion correctly describes the physics near Feshbach reso- 
nances at least in the following three limits. 

a) The high density limit where fermions mostly oc- 
cupy high energy on-site orbits. Generally speaking, 
other conversion terms are allowed and the Hamiltonian 
should be 

Hbf = -lFB{V,V')^blfk,j^fkrj'l+h.C., 

k,r]r]' 

1fb{v,v') ^ j dx4,l{x)^r,{x)il}^,{x), (2) 

if we assume the conversion is local. Here $o is the wave- 
function for bosonic molecules, and ipn.ri' are wavefunc- 
tions of ry, rj' orbits at a given lattice site. If $o is approxi- 
mated as a constant, thus the selection rule yields ij' — ij 
and molecules are only converted into two fermions in 
same orbits. In a harmonic trap where $0 is a Gaus- 
sian wavepacket, one then needs to take into account 
fermions in different orbits as implied and demonstrated 
previousljiSS^. 

However, if orbit rj and 77' correspond to highly ex- 
cited states, the conversion between molecules and time- 
reversal doublets is considerably larger than other terms. 
This yields dominating contributions in the large-A^ 
limit. In this case, the form of the on-site conversion 
term approaches the form in the bulk limit; up to a finite 
size effect, the conversion is between a bosonic molecule 
and two fermionic atoms in the same orbit because of 
the wavefunction orthogonality. The Hamiltonian with 
the conversion between a molecule and two fermions in 
same orbits thus describes the physics in this limit if M 
takes a large value and the number of fermions per site 
is big. 

b) The low density limit near narrow resonances when 
non-interacting fermions mostly occupy the lowest or- 
bit. In this case, one can argue that as far as the res- 
onance width is small compared to the spacing between 
the lowest orbit and higher orbits, the hybridization of 
molecules and atoms occurs in the lowest energy state; 
so fermions remain in the lowest orbit. One only needs 
to take into account resonances between molecular states 
and fermions in the lowest orbit. And in this case, the 
fermionic sector of the Hamiltonian is equivalent to a 
negative-C/ Hubbard model if one sets M to be one. (see 
more discussions in section VI). 

c) The low density limit with magnetic fields not too 
close to wide Feshbach resonances. The validity in this 
limit is justified by the following observations. Not too 
close to wide resonances, again the lowest eigenstate of 
two interacting fermions in a lattice site mostly involves 
two fermions in the lowest orbit and a molecular bound 
state. This implies that the fermion-boson conversion 



should again be described by terms such as bifkriifkrji , 
r] — 1. 

However, right at wide resonances, the molecule state 
is effectively hybridized not only with two fermions in the 
lowest orbit but also with two fermions in different orbits; 
this has been correctly pointed out and appreciated^^*^. 
Even in the low density limit where free fermions occupy 
the lowest on-site orbit, the above FBHM Hamiltonian 
when applied to Feshbach resonances is indeed no longer 
valid from this microscopic point of view. It remains to 
be understood how many-body physics will be affected 
by this complication. 

Without losing generality, in this article we study the 
effective low energy theory in a limit where the fermion- 
boson conversion strength is weak (i.e., narrow reso- 
nance) and discuss the issue of Mott states' instability. 
However, we would like to argue that physics discussed in 
this article would not be affected by the presence of ad- 
ditional conversion terms when the conversion strength 
is strong (i.e., wide resonance). The main reason is that 
the form of the long wave length effective Hamiltonian 
described below is subject to severe constraints from the 
symmetries and hydrodynamics in our problem and has 
little dependence on microscopies. As far as these extra 
terms only renormalize coefficients in equations of mo- 
tion but do not alter the general form of hydrodynam- 
ics discussed in the article, most of conclusions arrived 
here remain valid even in this delicate limit. This is evi- 
dent from a general renormalization point of view but has 
been unfortunately overlooked in the last two references 
of Refl2^ We believe that the significance of extra con- 
version terms on the long wave length physics has been 
overstated previously. 



III. DELOCALIZATION OF PARTICLES 
UNDER THE INFLUENCE OF FESHBACH 
RESONANCES 

In this section, we are going to study a Mott state 
under the influence of Feshbach resonances, especially 
the effect of fermion-boson conversion. A Mott state 
of bosons or Cooper pairs appears whenever bosons or 
Cooper pairs in lattices are strongly repulsively interact- 
ing and if the corresponding filling factors are integers. 
One of important properties of a Mott state is its incom- 
pressibility, or a finite energy gap in its excitation spec- 
tra, thus a Mott state is believed to be robust. When 
hopping is renormalized to zero due to repulsive interac- 
tions, the number of particles at each site can be strictly 
quantized and discrete; particles are locally conserved. 

Below we are going to show that in general Mott states 
are unstable with respect to Feshbach resonances. The 
primary reason is that particle numbers of fermions or 
bosons involved in resonating conversion are not con- 
served separately. So the conversion not only mediates 
an attractive interaction between fermions as realized be- 
fore, but also, more importantly violates the local con- 
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a) 
b) 
c) 

d) 



FIG. 1: Diagrams leading to the delocalization of bosons in 
Mott states. Solid lines with circles are for boson propa- 
gators while lines with arrows are for fermion propagators. 

a) (from left to right) bosonic propagators with no hopping; 
time ordered fermionic anomalous propag ators -ilTpf) 
and —i{Tff); the fermionic normal propag ators -i{Tf\f). 

b) (from left to right) vertices for hopping of bosons, and for 
fermion-boson conversion; c) The contribution to the bosonic 
propagator at a large distance due to hopping, d) The contri- 
bution to the propagator at a large distance due to fermion- 
boson conversion. 



servation law. This introduces new low energy degrees 
of freedom and results in a novel mechanism to trans- 
port particles. It leads to delocalization of particles in 
the limit of large repulsive interactions. 

To address the issue of localization of particles, we first 
introduce the following time-ordered Green's functionsi^ 



G\t,0;k,0) = 
Gf{t,0;k,0) = 



-t{Tbl{t)bo{Q)) 



'(0)/o,'*'(0)). 

(3) 



Now we assume tb/Vb <C 1 and the number of bosons 
per lattice site Ub is an integer so that the ground state 
of bosons is a Mott state. Without losing generality, we 
also assume that the chemical potential fi is precisely in 
the middle of the Mott gap so that the system is particle- 
hole symmetric and Vbf =0. Meanwhile, the number of 
fermion pairs per lattice site is either a non-integer or 
an integer but tf/Vf ^ 1 so that the ground state of 
fermions is a superfluid. We arc interested in the effect 
of fermion-boson conversion on the Mott state. 

When there is no fermion-boson conversion, one can 
evaluate the boson Green's function by an expansion in 
terms of the parameter tb/Vb. For instance, the zeroth 
order Green's function is 



G''"(e;fc,0) = ( 



rib 



Ub + l 



e-Vb + i5 e + Vb-i5 



:t)4.o, (4) 



reflecting the zero bandwidth in this limit. All low energy 
excitations are localized and gapped with a single energy 
Vb. Here Ub is the number of bosons per lattice site. The 
small finite hopping amplitude leads to corrections to this 
form of the Green's function; following the diagram in 



Fig. Ic, one finds that 



SG\e;k,0) - (- 



Vb' 



iS' 



(5) 



where is the distance between two lattice sites k and 
0. To obtain this result, we have assumed that Ub is much 
larger than one. It is obvious that at low energy e <C Vfc, 
the two-point Green's function decays exponentially as 
a function of distance Rk. Eq.(|SJl also implies that the 
localization length at small finite tb should scale as 



In 



-1 Vb 



ribtb 



(6) 



in the unit of the lattice constant. 

The localization of particles in a conventional Mott 
state is largely due to the absence of available low energy 
states below the energy scale set by Vb. So to remove a 
particle at the point and for the particle to travel to the 
point fc, one has to confront a sequence of energy barriers 
of height Vb- This blockade results in the localization. 

When a fermionic superfluid is present and the 
fermion-boson conversion occurs, there is an additional 
channel for a particle to travel from site to fe. The 
mechanism is schematically shown in Fig. 13 Instead of 
removing a bosonic particle from site and adding to 
site fc, one can remove a Cooper pair at site and trans- 
port it to site k. For this, a Cooper pair experiences no 
energy barrier imposed by repulsive interactions because 
there are sufficient low energy degrees of freedom avail- 
able for particle-hole excitations in a superfluid. At a 
latter stage, one then turns on Feshbach resonances to 
remove the boson at site by converting it into a Cooper 
pair to fill up the hole left behind by the transported 
Cooper pair; similarly, the Cooper pair transported can 
be converted to a boson as an additional particle at site 
k. The net effect is that a bosonic hole is created at site 
and bosonic particle excitation is now at site k. Since 
the fermionic channel has a long range order, this process 
therefore yields a long range particle-hole excitation. 

At a formal level, one can study this contribution by 
introducing a vertex for the fermion-boson conversion. 
Furthermore, in the weakly coupling limit, the long range 
component of the fermion Green's function reflects the 
usual off-diagonal-long range order. In the mean field 
approximation, one obtains 



Gf{e-k,Q)^5{e)F{Rk) 



(7) 



Here ... represents other contributions which decay over 
large distance. Let us emphasize that F{Rk) is a constant 
and is independent of the distance Rk between k and 0. 

Following the diagrams in Fig. QJi, one obtains the 
contribution of the boson Green's function 

SG\e;k,0)^{:^)'Gf{e;k,0). (8) 

Vb 

Eq. (jHJ illustrates two important properties of the state 
under consideration, which are intimately connected. 
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Firstly, the non-exponentially decay component of the 
boson Green's function is proportional to the off-diagonal- 
long-range order in the fermionic channel. The long range 
component in Eq.® shows that at least a fraction of all 
bosons actually become delocalized. The fermion-boson 
conversion effectively leads to the delocalization of bosons 
as argued above (also see Fig|5|for more explicit discus- 
sions); it is the delocalization of bosons which in fact 
induces superfluidity in the bosonic channel. 

Secondly, the zero energy peak (at e = 0) in the Green's 
function in the mean field approximation suggests that 
some bosons should now condense at the zero energy; 
the condensation fraction is (7FB/Vb)^. Notice that now 
the resultant bosonic state is compressible. It is thus 
implied that there should be additional low energy states 
well below the original Mott gap. These extra states are 
one of the consequences of the unusual hydrodynamics 
in the problem. We also anticipate that the low energy 
structure of SG'' such as the peak height is to be modified 
when various fluctuations are taken into account. 

In the next two sections, we are going to analyze the 
long range order in details. To understand the induced 
superfluidity, it is most convenient to first obtain an effec- 
tive theory where the typical issues of broken symmetries 
can be easily addressed. So in section III, we derive an 
effective coupled U{1) (E) U{1) quantum rotor model for 
the FBHM. In section IV, we employ the effective model 
to examine the long range order. 



IV. AN EFFECTIVE HAMILTONIAN AND THE 
EQUATION OF MOTION 

A. a ?7(1) ® U{1) coupled quantum rotor model 

We first study the large- N limit where and rif{< 
M) , the average numbers of fermions and bosons are both 
much bigger than unity. Because A is much larger than 
other coupling constants, the ground state of fermions for 
the on-site part of the Hamiltonian Hj naturally should 
be a BCS state. For simplicity, we also assume that the 
Fermi energy as well as the BCS gap are larger than the 
Fermi-Boson coupling strength ^fb so that we can ne- 
glect the Fermi degrees of freedom at low energies and 
obtain the effective Hamiltonian written in terms of var- 
ious collective coordinates (see below). 

This suggests that it should be convenient to work with 
the following coherent state representation. 



\{hk};{<l^bk}>=llT. 

ga{nbk) 



[exp(-«0bfc)b[] 



k ntk 



. J|(u„ + v„ e^p{-i(l)fk).fl^pfl^i)\0)- 



(9) 



Here the coherence factors in the BCS wave- 

function which minimize the total on-site energy; go{nhk) 
is a unity for rimax + rn, > ribk > Ub - n^ax, n^ax is 
much larger than one. These states form a low energy 



(a) 



(b) 



(c) 



(d) 



(e) 



(f) 



FIG. 2: Schematic of creation of particle-hole excitations 
with (a)-(d) and without (e)-(f) (color online) fermion-boson 
conversion. Thick circles with light blue color are for bosons. 
Thin circles for holes left by fermion pairs and filled circles 
with black color for fermion pairs. Lines below the periodi- 
cal structures are schematics of Fermi seas, a) The ground 
state of bosons (in a Mott state) and fermions (in a super- 
fluid state), b) Creation of a Cooper pair and a hole pair in 
fermionic superfluid channel at site 0; c) propagation of the 
Cooper pair to site k\ d) after the conversion of a boson into a 
particle Cooper pair at site and a particle pair into a boson 
at site k takes place, a final state with one extra boson at site 
k and a bosonic hole at site 0. The Fermi superfluid is in its 
ground state. In e)-f), a boson at site k and a bosonic hole 
at site are created without the fermion-boson conversion. 
Note in e), a particle effectively experiences an energy bar- 
rier with height 14; the amplitude of finding a particle-hole 
pair separated with a large distance is therefore exponentially 
small. 



Hilbert subspace and are orthogonal in the limit which 
interests us, or {\{4>'fk}'A4>'bk}\{^fk}'A'l^bk}\) is equal to 
zero if 0/^ ^ (ji'jf. or cjybk ^ 



Kk- 



At last, in the coherent-state representation one shows 



6 



that n/fe/2 = id/d(j>fk, and fibk = id/d<f>bk; 



[-n/fc,exp(-z0/fc/)] = Sk^k' exp(-i0/fc), 

[nbfe,exp(-i(/)bfc')] = 4,fc' exp(-i06fc). (10) 

So in the subspace of coherent states, we find the ef- 
fective Hamiltonian is 

Vi 



Heff = -Jf J2 cos(<?!>/fc - (t)fi) + -J Y^ififk - njf 

<kl> k 

-Jb ^ cos((/)6fc - (f)bi) + Vb ^{fibk - n.bf 

<kl> k 

- ^Tfs cos{(j>fk - (pbk) + Vbfifibk - nb){nfk - Uf). 

k 

(11) 

The exchange couplings J/, Jb and TpB can be estimated 



as 



U„VnU'„v',-l 



2 "-ly i^)) ",j ^, 



Jb = mh, Tfb ^ iFBy/nj^y^^u^Vn; (12) 



= a/ {e^ — y^Y + A§ is the quasi-particle energy and 
Aq is the BCS energy gap. Furthermore, 



the effective Hamiltonian describes two decoupled sets of 
quantum U{1) rotors in a lattice, the behaviors of which 
are well known. If rif /2 or Ub is a positive integer, the ef- 
fective model can be used to study superfluid-Mott state 
transitions. A Mott phase corresponds to U{1) sym- 
metry restored states and J7(l)-symmetry breaking so- 
lutions represent a superfluid phase. For the bosonic 
(Cooper pair) sector, the phase transition takes place 
when rf = zJf/Vf (rf, = zJb/Vb) is equal to a critical 
value Tfcirbc) iz{> 1) is the coordination number). The 
critical values which are of order of unity are usually cal- 
culated numerically. 

In the presence of F^s, the Hamiltonian Ea. Hll() de- 
scribes a coupled U (1) (g) U{1) quantum rotor model in a 
lattice. U(l) (E) U{1) symmetry breaking solutions when 
both rf^b are much larger than unity correspond to a su- 
perfluid phase. 

In general, the wavefunctions for the many-body 
ground state and excitations '^n{{'t>bk}]{'t>fk}){n — 
0,1,2,...) are the eigenstates of the Hamiltonian in 
Ea. (|ll|) . The boundary conditions are periodical along 
the directions of (t'fk,bk with a period 27r, so the wave- 
functions are effectively defined on an (8) 5'"'^ torus with 
radius of each equal to one. If the average number 
nf/2 and Ub are integers, one introduces a gauge trans- 
formation 



* *]^exp(-m/0/fc/2 - iubcfibk); 



(15) 



d'^Skjrifk) 
dn}k 



(13) 



£k is the on-site energy of Ufk particles and its second 
derivative is inversely proportional to the compressibil- 
ity of a BCS state. In a recent work of one of the 
authors^i, it was assumed that Vf is much bigger than 
the second term in the above equation and V'^ ~ Vf. 
However, when Fermions do not have repulsive interac- 
tions in the density-density channel {Vf = 0), Vj is equal 
to d^BCS / dufk, ^^Bcs is the chemical potential of n/ 
fermions in a BCS state, which is typically of order of 
the one-particle level spacing at each lattice site. From 
now on, we will assume Vf is much larger than the level 
spacing and omit prime in V'^ 

Uf and Ub are functions of /i, v and Vf^b.fb'- 



the shifted number operators become 



5nfk/2 = - {fifk - Uf) = id/dcjjfk, 



Shbk fibk ~ rib^ id/d(t)bk- 



(16) 



The effective Hamiltonian and eigenstates in the shifted 
basis are given by the following equation 



d d 



9(b}^ d(plk ' d(f>fk d(f>bk 

-Jf ^ COs{(f>fk - (j)fl) - Jb'^ C0s((/)f,fc - (f>bl) 



<kl> 



<kl> 



-TFB^COs{(j)fk - 0bfc)]5'„ = En'i'r, 



(17) 



rib 



2H(Ato + Vf/A) - Vbf{2fi ^v + Vb) 



V}{2ii 



VfVb ~ V,) 
^Vb) -Vbf {2^io 



Vf/2) 



2{VfVb 



(14) 



It is evident, following the above equations that when 
both fermions and bosons are in superfluid phases, quan- 
tum phases of two superfluids are locked to minimize the 
potential energy —T p b coB{(l)bk — (f'fk)- That is 



Here /io — M ~ ^^BCS■ Obviously, the detuning energy v 
has to be sufficiently small in order for Ub to be positive. 

Eq. (|10|l and Eq. (|11() define the low energy quan- 
tum dynamics of fermions and bosons under the influence 
of fermion-boson conversion in Feshbach resonances. In 
the absence of Feshbach resonances (TpB = 0) and VJ, / , 



0/fe = 0bfc = 00- 



(18) 



So in this new basis a spontaneous symmetry breaking 
solution with the wavefunction 



^ -Y[S{(f>fk ~ (l>o)5{cj)bk - 0o) 



(19) 
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represents a typical superfluid. A symmetry-unbroken 
solution with the wavefunction 

* n (^tt)"^ exp{imfk(pfk) <E) expiimbkfpmk) (20) 

A; 

(jnfk,bk — for all k) on the other hand corresponds to 
a Mott state with 5hfk(bk)^ = or nfk(bk)'^ — "/(fc)^ 
each lattice site. 



B. The equations of motion and general features of 
collective modes 



Here the matrix elements Ma,p{a,f3 = b, f) are defined 
as 

" 2VfVb-V,y 
_ 1 Vf 

M., = M/.^4^^^. (24) 

The eigenfrequencies of modes are the solutions of the 
following equation 



In a superfluid phase, the Hamiltonian in Ea. (|ll(l fur- 
ther leads to the following semiclassical equation of mo- 
tion in the long wave length limit 



d(l)fk 
dt 
d(f)bk 



dt 

1 dSfifk 

2 dt 

dt 



= VfSfifk + 2VbfSnbk, 
= 2VbSnbk + VbfSfifk, 

JfAipfk + TFB{4>bk - (t)fk), 



JbA(j)bk + ^FB{(t>fk - 4>bk) 



(21) 



Here 5hfk,bk = nfkfik — TT'f,b- we have taken a continuum 
limit and A; labels the coordinate of phases of bosons and 
fermion pairs {<j)fk,bk) in this equation; A is a Laplacian 
operator. The lattice constant has been set to be one. 
The above set of equations were previously derivedSl. 

In the absence of Fermion-boson conversion, the third 
and fourth formulae in Eq. (|21|1 are the conservation laws 
for fermions and bosons respectively. 



1 dSfi.fk 

2 dt 
dSfibk 

dt 



+ V • J/fc = 0, 
V • Jfcfc = 0, 



(22) 



where supercurrents are defined as 3 fk,bk = 
—Jf,b^4'fk,bk (the definition of phases differs from 
the conventional one by a minus sign). Obviously, the 
fermion-boson conversion violates the conservation law 
and introduces a source term which is proportional to 
TpB- It is this new quantum dynamics which yields the 
delocalization in the previous section. Below we show 
that in addition to the usual gapless Goldstone mode, 
the quantum dynamics in this case also leads to a new 
branch of collective modes which are fully gapped. 

Let us introduce the plane wave representation for 
4>fk,bti^) ^^'^ study the eigenmodes. The above semiclas- 
sical equation suggests spectra of collective excitations. 
The equation for eigen modes cjij^bi^, Q) reads as 



f Mff Mfb 
\Mbf Ml 



FB 



bb 

1 -1 
-1 1 



Jf 





(23) 



-[Q^JfVf + JbVb) + TpBiVf + Vb 



2H/)] 

(25) 
one ob- 



4 2 

+ [JfJbQ^ + TpB{Jb + Jf)Q'']{VbVf - vfb). 

By solving the equation for eigen frequencies, 
tains the collective mode spectrum. The above equation 
shows that there should be two branches of collective 
modes the dispersion relations of which are given below: 

a)w2 =a|Qp,(/./(w,Q 
6)a;2 = Og+/3|Q|2, 

Vf - Vbf 



0) = 0,(w,Q^O); 



0/(w,Q^O) 



Vb - Vbf 



,{uj,Q^Q). (26) 



(/>y f,(cij, Q) are the Fourier components of phase fields 
4>fk.bk{t)- It is worth emphasizing that in the long wave 
length limit, mode a) is fully symmetric in phase oscil- 
lations of fermions and bosons, independent of various 
parameters; mode b) represents out-of-phase oscillations 
in fermionic and bosonic channels and becomes fully an- 
tisymmetry when Vb = Vf. In the absence of conversion 
(TpB — 0), these two modes correspond to two gapless 
Goldstone modes associated with breaking two decoupled 
C/(l) symmetries. However, in the presence of Feshbach 
resonances only the symmetric mode a) remains gapless 
corresponding to the usual Goldstone mode of superfluid 
while the antisymmetric mode b) is fully gapped because 
of the phase-locking effect of Feshbach resonances. 

In general, Qq, a and /? depend on various parameters 
in the Hamiltonian; Qq is always proportional to TpB, 
and a on the other hand is independent oi TpB- When 
Vbf =0, Vf = Vf, = Vb and Jf = Jb = Jq, Eg becomes 



4 9 
— - y[2JoFog2 



- 2rpBVo] 

2rpBJoVo^Q^ = 0. 



(27) 



Consequently, the dispersion relations are given by 
Eq.(j2n|) with = iVpBVo, 13^ 2JoVb. 

A more interesting and realistic limit is when Vbf is 
small and set to be zero but Vbj are not equal. In this 
case, Ea. (P5)l becomes 



4 2 

\ ~ \\Q\jfyf + w + ^FB{Vf 

+[JfJbQ^ 



TpBiJb + Jf)Q^]VbVf 



+ Vb)] 

(28) 
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One then obtains the dispersion with coefRcients given 
below 



a = 2{Jf + Jb) 



VbVf 
Vf + Vb' 



Vf + Vb 



nl = 2rFBiVb + Vf). 



(29) 



Note that in the noninteracting hmit, Vf is equal to 
dfi/dnf and is finite. The above equations show that 
the velocity of mode a) (the symmetric Goldstone mode) , 
decreases when interactions between bosons Vf, be- 
come smaller. This is because as bosons become weakly 
interacting, the density fluctuations in the symmetric 
mode are dominated by those of bosons and the fermion 
density fluctuations become insigniflcant. So although 
the sound velocity of fermion superfluids is flnite, the 
fermionic contribution to the symmetric mode is negligi- 
ble and the Goldstone mode becomes softer and softer as 
Vb goes to zero. 

On the other hand, the gap in the antisymmetric mode 
b) remains finite in the limit when Vb — 0; that is 
rig = 2rFBVf. As discussed in the previous subsection, 
if repulsive interactions between fermions are zero, Vf 
approaches the value of dfji/dubk- One also notice that 
when Vbf is zero, the total density fluctuations in mode 
b) at Q = are zero, that is 



Sribk 



-Sn 



fk 



(30) 



following the last equation in Eg. pGfl . 

The above semiclassical approach to collective modes is 
valid when Vf\bjb are small so that various renormaliza- 
tion effects can be neglected. Collective modes in a large- 
V limit can be more conveniently studied using a saddle 
point expansion. This alternative approach to study the 
collective modes is explored in a unpublished workSS. 



V. DEVELOPMENT OF ODLO IN A LARGE-V 
LIMIT 

A. Molecule mean field approximation 

We first introduce order-parameters to classify various 
states. The order parameters which can be used to clas- 
sify states are 



> 



(31) 



When Ah is nonzero (zero) , the ground state is a bosonic 
superfiuid (Bosonic Mott state), or SFb (Mlb). When A/ 
is nonzero (zero), the corresponding state is a fermionic 
superfiuid (fermionic Mott state), or SFf (MIf). 

Below we demonstrate the invasion of superfiuidity into 
a parameter region where only Mott states are expected 



(SFfMIb) 


(SFfSFb) 1 


MI (MIfMIb) 1 


! (MIfSFb) 1 



'be 



FIG. 3: Phase diagrams with (solid lines) and without 
(Dashed lines) Feshbach fermion-boson conversion, r/c and 
r^c are the critical values for the superfluid-Mott insulator 
transitions for the decoupled fermionic Cooper pairs and 
bosonic molecules respectively. Phases in brackets are the 
ones without Feshbach fermion-boson conversion and are sep- 
arated by dashed lines. Note in the presence of fermion-boson 
conversion, due to the invasion of superfluidity to MI phases, 
the original SFfSFb, SFfMIb, MIfSFb phases, and a small 
portion of the MIfMIb phase merge into one single superfiuid 
phase specified as the shaded area. 



to be ground states if there were no Feshbach resonances. 
To understand the influence of Feshbach resonances on 
Mott states, we first consider a situation where again 
both Ub and nf/2 are integers and rb is much less than 
rbc, so that bosons are in a Mott state in the absence of 
Feshbach resonances. On the other hand is much big- 
ger than the critical value rfc so that Cooper pairs are 
condensed. For simplicity, we have also assumed that 
Vbf is much smaller than Vb so that it can be treated 
as a perturbation. We are interested in the responses 
of bosonic Mott states to fermion-boson conversion and 
carry out the rest of discussions in a mean field approxi- 
mation (MFA). 

In this MFA, (j)fk = (f>f, 4>bk = 4>b for any lattice site 
k. The ground state ^'o((/)6,0/) (again defined on an 
(g) iS*^ torus with radius 27r) is the lowest energy state 
of the following MFA Hamiltonian 



Hmfa 



-""Vf 
z{JfAf cos( 
Tfb cos(0/ 



Vb 



92 



214/- 



d d 



b d(j)f d(j)b 

h Jb^b cos (j)b) 

b)- (32) 



Here again z is the coordination number; we have also 
introduced two self-consistent order parameters 



/'27T /'Z7T 

Abj = (cos^fc,/) = / d(j)f / d(j)b cos (j}bj'^o% ■ 
Jo Jo 

(33) 

Here () stands for an average taken in the ground state. 
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and Vto is the ground state wavefunction. Notice that the 
order parameters defined above are nonzero only when 
the U(l) symmetries are broken; particularly, A/ is pro- 
portional to the usual BCS pairing amplitude. Following 
Eq.@ and discussions above one indeed shows that 

=< fin fill >= (IZ"')"'))^/' 

n 

Ab =< bl >= V^Af,. (34) 

So A/^b vanish in Mott states and are nonzero in super- 
fluids. 

As zjf is much larger than Vf, <j)f has very slow dy- 
namics; and the corresponding ground state for (j)f can 
be approximated as a symmetry breaking solution. In 
the linear order of Jf, and F, one obtains the following 
solution 



■^o((t)f,(j)b)^-^ob{(t)b)®5{<i)f), 



L FB 
Vb 



A/) cos( 



(35) 



Here A/ should be approximately equal to one in this 
limit; and in the zeroth order of Vf^^ , 5*06 does not break 
the U{1) symmetry and stands for a Mott-state solution. 
Finally taking into account Ea. (|33|l and (|35|l . one finds 
that the self-consistent solution to A;, is 



Ab^^ 



IF 



FB , 



Vb ^ 2 Vb^ 



(36) 



In the absence of Fi?^, A;, vanishes as expected for a Mott 
state. However, the Mott state solution is unstable in the 
presence of any Feshbach conversion and the molecular 
condensation order parameter Af, is always nonzero in 
this limit. 

We want to emphasize that the average number of 
bosons per site is not affected by the fermion-boson con- 
version and remains to be an integer (J); rather, closely 
connected with the instability is the breakdown of par- 
ticle number quantization. Indeed, one obtains in the 
MFA the following results for fibk, 



< fibk >= nb = I,< 5'^fibk >= l/2{rFB/Vb)' 



2Al 



(37) 

This illustrates that the resonance between states with 
different numbers of bosons at a lattice site eventually 
leads to a nonzero molecular condensation order param- 
eter Ab- 

Alternatively, one can consider the renormalization 
of the condensate amplitude due to enhanced quantum 
fluctuations when repulsive interactions are introduced. 
When repulsive interactions are weak, one can carried 
out usual perturbative calculations. 

The results above on the other hand provide informa- 
tion about what happens when interactions are dominat- 
ing and the conventional perturbation expansion fails. 




FIG. 4: Schematic of the renormalized condensate amplitude 
Ai, as a function of Vb {tb is given and set to be unity). The 
solid line and dashed line are for the case with and without 
fermion-boson conversion respectively. 



One of the most important consequences of fermion- 
boson conversion is that the suppression of condensate 
amplitude is never complete if one increases Vb only while 
maintaining small value of Vf. The renormalization of 
the condensate amplitude as a function of Vf, is plotted 
schematically in Fig. 4. 

At last, let us briefly consider the case that both bosons 
and fermion pairs are in Mott states, i.e., rf, < rbc and 
Tf < rfc respectively. Then the mass gaps in two chan- 
nels behave like mf, cx rbc ~ i"b and TOc c>c rfc — rf in 
the absence of the boson- fermion conversion term TpB- 
The conversion term leads to a hybridization between 
two components, and we can diagonalize their mass ma- 
trices to find the new mass gaps. When F^ > mfrrib oc 
irbc—rb){rfc—rc), one eigenvalue becomes negative which 
suggests that the Mott state should be unstable, i.e., a 
superfluid state should be formed. 



B. Saddle point approximation 

In this subsection, we are going to provide an alterna- 
tive approach to ODLO based on a saddle point approxi- 
mation. We will show again that any finite fermion-boson 
conversion leads to a finite condensation of bosons dis- 
regarding the strength of repulsive interactions between 
bosons. 

For this purpose we first introduce the following par- 
tition function 



Z 
Sf 



J DpDfDb^Db cxp{-iSf + Sb + Sbf)} (38) 



J -dr 
5/|(r)/l(r)/i(r)/T(f) 

P 



dr I df /t(f){_ + e(V)-/i)}/.(r)(39) 

(40) 



Sb ^ I dr Y,bl^bk-tY,[blbi + h.c] 

k (ki) 



2^^T.^lbk + ^Y.^lbk{bibk-l) 



(41) 
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Sbf - 



fdTj2 r[blfdk)Mk) + b,flik)flik)}, 



(42) 

where j „{r) ^ f^ir) are fermion field variables defined in 
the continuum, 6^ are the field variables for bosonic 
molecules in the closed channel defined at lattice site fc, 
faik) is a coarse average of fcr{r) within the fc-th unit 
cell as 



dr fair), 



(43) 



where n is the volume of one unit cell. 

For the reasons outlined in Appendix A, it is more 
convenient to introduce a ^-field variable to describe the 
dynamics of bosons; the (/)- field can be interpreted as the 
condensate wavefunction. Following discussions there, in 
the long wave length limit we obtain the following (j>*- 
theory description of bosons 

(44) 



S'tf = I dr I df r 



{'^t(r)/i(r)/T(r) 



(45) 



According to Appendix A, when the system has a 
particle-hole symmetry, one can set r' to be zero. This 
also corresponds to a system where Uf, is an integer, a sit- 
uation we have discussed in the previous session. More- 
over, when a > 0(< 0), the system is in a Mott phase 
with an energy gap (in the superfluid phase). 

Using the standard Hubbard-Stratonovich transforma- 
tion, we decouple the 4-fermion interaction term by in- 
troducing the pairing field A. After integrating out the 
fcrmions in S*^^, Sf (see Appendix A, B and especially 
Eq. IBll IB2|) , we arrive at the following effective action 

^eff. — Sc/, + SaiP 

Sac/, = det|^ + GiTi + G2T2 + G3T3}, 

Gi = -(ReA(r,T)-hrRe0(r,T)), 
G2 = -(ImA(r,r)+rim(/.(r,T)), 
G3 = e(V)-M), (46) 

where ti_2,3 are the Pauli's matrices in the Nambu's rep- 
resentation, and T^^- = (ti ± ir2)/2. 

Consider the standard mean field ansatz 



tion for A and 

A 
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-y 



a0 + A|0r0 



A-K> 
2Ek 

r 



V 



E 



2Ek 



0. 



(48) 



The dispersion relation for quasi-particles is 

i?2 = (e,-^)2 + |A + r0|2. (49) 

Ea. H48|l is of the same form as the equation for A, 
derived in a zero-V limit where bosons and cooper pairs 
are non-interacting. However, in our case, the equation is 
valid even when various repulsive interactions are strong 
and bosons are in a Mott state. We derive the relation 
between ((> and A from Eq. 1481 as 



4 + x\4>\^4>^T 



A 
9 ' 



(50) 



It is clear the saddle point values of (j) and A are locked 
with the same phase. For convenience, we assume both 
of them to be real in the following. 

First consider a situation when molecules are deeply 
in the Mott state, i.e. a > F, A > 0. Eq. EOI can be 
approximated up to F's second order as 



F 



A/g a 



(51) 



This equations shows that condensation amplitude of 
bosons is finite for any finite coupling F, disregarding 
the value of a. When F is nonzero, this equation indi- 
cates that the minimum for the total energy should be 
located at a finite (f) instead of zero. 

On the other hand, if molecules are deeply in the su- 
perfluid state, i.e., —a 3> F > 0, the solution to Eq. [501 
can be approximated as 



(52) 



where is the saddle point value without the boson- 
fermion conversion, and (t>' is the correction, 



1 F A 
2aJ- 



(53) 



It is worth remarking again that in this limit the phase 
of (f> is precisely locked with the phase of A, following 
Ea. (|50|l . This is consistent with the Hamiltonian-based 
discussion in section IV A. 



A(f, t) = A + 6A 4>{f, r) -f 1 



(47) 



VI. ODLO IN THE SINGLE BAND LIMIT 



Taking into account the contribution from molecules in 
Eq. we then obtain the standard self-consistent equa- 



The main conclusions arrived so far do not depend on 
the large-N approximation introduced above. One can 
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consider the opposite limit by assuming M = 1 and there 
is only one orbital degree of freedom at each lattice site. 
In the single-orbit limit, the two interaction terms (with 
two interaction constants A and Vf ) in Hf (see Eq. ^) 
can be rewritten in one term: Vj nfk{nfk — 1) if one 
identifies V'^ — Vf — 2X. In the limit where A is much 
larger than Vf, fermions are paired at each lattice site. 
Furthermore, I assume bosons have hard core interactions 
{Vh — oo) such that there can be only zero or one boson 
at each site. 

So the low energy Hilbert subspace Sk at each lattice 
site k consists of four states: 1) no Cooper pair, no boson; 
2) no Cooper pair, one boson; 3) one Cooper pair, no bo- 
son; 4) one Cooper pair, one boson. They also correspond 
to a product of two pseudo spin S* = 1/2 subspaces: 

Sk = Sfk ® Sbk, 

|a|fe = ±l>e5/,,K, = ±l)€5fcfc; (54) 

Sk is the on-site Hilbert space, and Sfk^bk £^re the on-site 
pseudo spin spaces for fermions and bosons respectively. 
More explicitly, these four states are 

i^/fe = 1) = fhfii\v^c)f, 

Wbk = -1) = \vac)f; 

Wbk 1> = bl\vac)b, 

- -1) - |mc),. (55) 

\vac) f^b are the vacuum of fermion and bosons respec- 
tively. Finally, in this truncated subspace, the following 
identities hold 

^/fe = fk]fkl''^fk = fklfkl, 

<^fk = /fct/feT + fkifki - 1; 

'^tk = bla^, = al, = 2blbk - 1. (56) 

So to have superfluidity, either (Jbk or crfk, or both of 
them need to have a finite expectation value in the XY 
plane. For instance to have fermionic superfluids, the 
expectation values of cr^j, need to be nonzero. 
The effective Hamiltonian can then be written as 



polarized phase of pseudo spins abk (crfk) represents the 
Mott phase of bosons (fermions), and the XY symme- 
try breaking states of pseudo spins abk {<^fk) stand for 
the superfluid phase of bosons (fermions). The fermionic 
sector of this Hamiltonian was previously obtained and 
studiedSS; it was also used to study BEC-BCS crossover 
in lattices^^. 

When Tpg = 0, the Mott phase for bosons with filling 
factor equal to one occurs when is much larger than 
Jb- Assume that in this case /i^ is much less than Jf so 
that (Jfk are ordered in the xy plane; then fermions form 
Cooper pairs. Taking into account a finite amplitude of 
rj^g , one considers a solution where the pseudo spin sym- 
metry of dfk is spontaneously broken along a direction in 
the XY plane specified by {(Jfk) (the expectation value 
is taken in the ground state). 

In the molecular mean field approximation, the effec- 
tive external field acting on pseudo spins Ubk is 

hb.eff = zJb{(Tbk) + T^FBi^fk) + K^z- (59) 

{ubk) is calculated self-consistently in the ground state 
when hb^eff is applied; the effective MFA Hamiltonian is 

HmFA = — f?6/c • hb,eff- (60) 

One then arrives at the following self-consistent solution 
(^..>-(^A>-^|^(l-^)-\ (61) 

where {<7bk) has been projected along the direction of 
{(Jfk) which lies in the XY plane. As mentioned before, 
development of such a component signifies superfluidity, 
or molecular condensation. 

To summarize, we have shown that certain Mott states 
are unstable with respect to the resonating fermion-boson 
conversion; in general superfluidity invades Mott phases 
because of the fermion-boson conversion. 



VII. HIDDEN ORDER AND VORTICES IN 
MOTT STATES 



Hlff = -Jl E [^bk< + <k<i} -kY. ^% 

(kl) k 

-Jf E {-h'^h + ^)k-)i - -h-h} - ^/ E 

(kl) k 

-rFsEl'^A^fe + ^Wj- (57) 

(see also Ref l27j) Here 

j} = ^^l^f^ Jb = 

= IFB, h} = fi + V}/2, hl = ^,- v/2. (58) 

The Hamiltonian is invariant under a rotation around 
the 2-axis or has an XY symmetry. The z-direction fully 



In addition to introducing superfluidity to Mott states 
in some limit, the fermion-Boson conversion also results 
in a hidden order in Mott states. In the presence of 
fermion-boson conversion, one finds it is more convenient 
to introduce trilinear order parameters to characterize a 
Mott state 

Kf = (bifljl-a)^ ^bf = {bifk,.fkn-a). (62) 

A superfluid phase would have a nonzero order parame- 
ter of type, but A^j can be either zero or nonzero. 

For a usual superfluid near Feshbach resonances, A^ is 
nonzero. However, there might be more exotic super- 
fluids where A^ is zero; when this occurs, the super- 
fluid will have two decoupled components with unlocked 
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phases. On the other hand, a Mott state has vanishing 
but always has non-vanishing A^^ as hidden order 
as far as the fermion-boson conversion is present (see be- 
low). Here the appearance of AjJ^ order is due to the 
fermion-boson conversion. Effectively, it can be viewed 
as an order parameter of a boson and a Cooper-pair hole 
pairing, which bears resemblance of the electron-hole ex- 
citon formation in semiconductorsi^ and in quantum Hall 
bilayer systems^. 

To understand this issue, we first consider an extreme 
situation when Vf = Vb = Vbf = Vq and all of them are 
much larger than tbj and "fPB- Minimizing the potential 
energy leads to the following constraint on Ufk^bk in the 
ground state 



(63) 



Here / is an integer, Int[/ + e] is equal to / if < e < 1/2, 
and to / -|- 1 if 1/2 < e < 1; at e = 1/2, Int takes either 
/ or / + 1 . Let us assume that the chemical potentials 
and interactions are such that Nfi, is equal to an integer 
/. All states satisfy the constraint are degenerate when 
7f_r is zero, and thus the degeneracy is proportional to 

In this limit, we can truncate the Hilbert space and 
consider the effect of Fermion-boson conversion in the de- 
generate subspace only. We study the following ground 
state trial wavefunctions constructed out of these degen- 
erate states, 

|<?) = [[exp{~i(j)kfbnkfb} 22 l^fTf 

V W^, 



{"fe,,} V 



ft - nkfbV. 

(64) 



where n^, = or 1 satisfying Y^r^'^kr, = nkfb, w{nkr,) = 
at Uk-q = and at Ukrj = 1, respectively (u^, are 
coherence factors). One can easily verify that states with 
different {<t>kfb} are approximately orthogonal when Nfb 
is much larger than unity. 

But any finite conversion leads to a lift of degeneracy. 
The energy associated with the conversion is 



E ~ -Tfb E cos{4>kfb)- 



(65) 



Minimization takes place when (j)kfb = for any lat- 
tice site k. The symmetry here is broken not sponta- 
neously as in superfluids but actually broken explicitly 
by the fermion-Boson conversion. The ground state is 
non-degenerate and does not have the usual U{1) vac- 
uum manifold. 

This state is characterized by the following expectation 
values 



(blfkriafkri-a) ^ Nfb- 



= 



The existence of the trilinear order in Mott states is very 
unique and defines a hidden order. There are a few con- 
sequences. One is the collective excitations. In addi- 
tion to excitations which have an energy gap Vq, there 
are another branch of excitations involved the creation 
of a bosonic particle and annihilation of a cooper pair, 

Egi,g2 ^li+QfQ2vlf-Q2+qivl'^ t^^^sc cxcitatious are gapped 
by the energy of order Tfb instead of the Mott gap. 

Furthermore, a hidden order also implies new classes of 
topological excitations. The wavefunction of a topologi- 
cal excitation centered at the origin is given by Ea.H64|l 
where (f>kfb is defined by the following equation 

(bkfb = HRk); (67) 

$(i?fc) is the azimuthal angle of Rk- The vortex is orien- 
tated along the z-direction. The energy per unit length 
of this excitation unfortunately scales as the area of the 
system in the xy plane; i.e. 

^-TfrY^I^- cos(0fe/b)] = L^LyTpB- (68) 
k 

The situation discussed here is not generic and requires 
fine tuning. Let us now turn to a more general situation 
where Vb ^ Vf. If rbj are much smaller than rbc.fc, then 
both Cooper pairs and bosons are in Mott states. Up to 
the first order approximation of F pB , the corresponding 
wavefunction is 



_|_ g^irkk/b 



FB 



{rikr,} V 



Vb + Vf ^{rifb ±1)1 



(69) 



{"LI ^ 



where the distribution n^^ satisfies J^n ^'krj = ± 1, 
and Hkri satisfies Ukri = nf /2. (j)kfb has to be uniform 
and zero for the ground state. 

Similar calculations lead to self-consistent solutions 
A^ = Ab = and more importantly, the following corre- 



lations for A^ 



F^ 

^ FB 



''^^ 2jFBiVf + Vb)' 



A+ = 0. 



(70) 



The second equality above simply shows the absence of 
superfluidity. But the first one indicates a subtle hid- 
den order in the Mott states under consideration. Notice 
that A^ represent tri-linear order and are proportional 

to (cos(0fe6 ± (j>kf))- 

One can easily show that the vortex wavefunction is 
given by the same expression but with 0fc/b = ^{Rk)', 
the energy per unit length in this case is much smaller 



(66) 



Ev 
L, 



^FB 



Vf + Vb 



(71) 
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APPENDIX A: THE EFFECTIVE ACTION 

In this section, we present the effective action for the 
boson-fcrmion conversion in the optical lattices near Fes- 
hbach resonances. We start with the microscopic actions 
of Eq. EHl EH El in Sec. VB. Eq. Ei describes the 
attraction in the open channel for the formation of BCS 
Cooper pairs; Eq. 1411 describes the Bose-Hubbard (BH) 
model of the boson molecules with t the hopping inte- 
gral and U the on-site repulsion; Eq. E21 describes the 
conversion between the Cooper pairs and molecules. 

The BH model of Eq. El exhibits a superfluid (SF)- 
Mott insulating (MI) phase transitionSS. The MI phase 
only exists in the strong coupling regime with commensu- 
rate fillings, i.e., small values of t/U and integer values of 
niy. The SF-MI transition can be obtained by two differ- 
ent ways. First, the boson filling is kept commensurate 
while t/U is tuned larger than the corresponding critical 
value. This transition belongs to the XY universal class, 
and the resulting SF is particle-hole symmetric. Second, 



we can also add or remove particles to the commensurate 
MI background, i.e., dope the MI with extra particles or 
holes. Because the particle-hole symmetry is broken, this 
transition is not XY-like. The resulting SF are either 
particle-like or hole-like. Consequently, although only 
one connected SF phase exists in the phase diagram, it 
actually exhibits rich structures, including the particle- 
like, hole-like, or even relativistic (particle-hole symmet- 
ric) SF, which are connected by smooth cross-overs. 

The bare boson operators b^, fej^ in Eq. 1411 are for non- 
relativistic particles. However, near the SF-MI transi- 
tion, it is not convenient to use them to describe above 
rich structures in the SF phase. For example, bk means 
both an annihilation of a particle and a creation of a 
hole in the MI background. On the other hand, the SF- 
MI transition is in the strong coupling regime by using 
the bare operators of bk,b\^ and it is hard to do per- 
turbation theory for the Hubbard U term. Thus we fol- 
low Fisher et al.^'^ to introduce another complex bose 
field (/)(r) to describe the molecular superfluidity. This 
can be formally done by keeping the on-site Hubbard 
term in Eq. 1411 as the leading term, and decoupling 
the inter-site hopping term as perturbations. Basically, 
this transformation turns the original strongly interact- 
ing non-rclativistic systems into weakly interacting quasi- 
relativistic systems. It is shown in the equation of motion 
that (f) plays the role of the expectation value of 6 in the 
ground state, i.e., (j) is the superfluid order parameter. 

Phenomenologically, the symmetry allows an effective 
action for the (/)-field upto the quartic level as 



dr / dr 



0t(F)| 
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dr dr^ 



(Al) 



which includes the r, k, a, X terms as in the standard rel- 
ativistic complex 0"* theory, and also an additional first 
order time derivative term of r' . Whether the mass a > 
or a < determines the system either in the MI phase 
with a charge gap or in the SF phase, respectively. All 
these coefficients in Eq. lAll can be determined by the val- 
ues of t, U, fi in the original BH model perturbativelySS. 
However, for simplicity we treat them as phcnomenolog- 
ical parameters. It is proved through gauge invariance 
that r' is related with a throughSS 



da 



(A2) 



Near the SF-MI transition, as the filling rif, changes from 
one integer to another integer, the superfiuidity is en- 
hanced and suppressed alternatively. As a result, a os- 
cillates, and then r' can be negative, positive, or even 
zero. Roughly speaking, when n is larger (smaller) than 
an integer number, r' > (r' < 0), and then the sys- 
tem is particle- like (hole- like). As long as r' ^ 0, the 
first order time derivative term dominates over the sec- 
ond order one below a certain energy scale in the sense of 
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the renormalization group (RG), and the system is non- 
rclativistic. When is commensurate, the superfluidity 
is in a local minimum, and thus r' = 0, i.e., the system is 
particle-hole symmetric. In other words, the r term be- 
comes the leading order term, and the system becomes 
relativistic. 

Many possible terms coupling the superfluid field 
and fermions fl,fk together are allowed by symmetry. 
Among them, the linear coupling term is the most rele- 
vant one in the sense of RG as 

S'bf = f^dr j df T[4>HT)f^{r)f^{T)+c.cY^i) 

Here we use the same symbol T for the coupling constant 
as in Eq. l42l for convenience. However, we need to bear in 
mind that the T here receives significant renormalization 
from its bare value in Eq. 1421 

The action for the fermion BCS interaction in Eq. 
is already defined in the continuum. Combined with Eq. 
lAll and Eq. IA3I these three terms give the effective action 
for the boson-fermion conversion. 



APPENDIX B: SELF-CONSISTENT EQUATION 

In this section, we derive the self-consistent equations 
for the coupled superfluids of bosonic molecules and the 
fcrmionic Cooper pairs. Using the standard Hubbard- 
Stratonovich (HS) transformation, we decouple the 4- 
fermion interaction term in Eq. 1391 in terms of Cooper 
pair filed A as 

DfDpexp[jyT J dr{.g/t(r)/|(r)/i(r)/T(r)} 

J DA^DADfDp exp|-^^dT J df\^-A\f)A{f) 
AHf)f,if)f^{f) A(f)/t (f)/|(f)}. (Bl) 



Now all the fermion terms in Eq. IJH and Eq. IA3I 
become quadratic, we can integrate out them using the 
Nambu's representation 



DpDf exp { - ^ drj dr (/|, + (e(V) 

/i)T3 - (At(f, r) + Tc^^f, T))r_ - (A(f, t)+T 



X 0[r 



/t 



;r))r+} 

exp |tr log { ^ + (e( V) - ^i)t3 - (RcA(r, t) 
r Re(/.(r,T))ri - (ImA(r, r) + E Im0(r, r))T2} }, 



(B2) 

where ti_2,3 are the Pauli's matrices in the Nambu's rep- 
resentation, and T+,_ = (ti ±ir2)/2. This leads to the 
result in Eg 1461 

We set the mean field ansatz as 

A(f, t) = A + 6A (l){r, t)^4> + 5(j), (B3) 

where A and (j) are the saddle point value, while 5 A and 
5(j) are the small fluctuations. Then the single particle 
Green's function reads 



G(p,t-t') 



r(cp(r)ct(r')> T{c,{T)c^,{r')) 
T(cL,(r)ct(r')) T {cI^{t)c^,{t')) 



(B4) 



where T is the time-order operator. Its Fourier trans- 
forms become 

where the G(jp,ipn) and T{p,ipn) are the normal and 
anomalous Green's functions respectively. More explic- 
itly, they can be written as 



Wn - Ep ipn + Ep 

T{p,ipn) = T\p,ipn) 



with 



with the dispersion relation 

El^{ep~tif + {A + T^f. 



(B8) 



The saddle point equations are determined by the var- 
nishing of the first order variations of the effective action 
Eq. IB 21 over 6 A and 5(j). They are 



A _ 1 



J2 tr{G(A,0;p,ip„)r_}, 



a(j) + \\(j)\'^(j) _ J_ 



^ tr{G(A,0;p,ip„)r_XB9) 



After performing the summation over frequency, we ar- 
rive at Eq. EHl 
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